Modified Uni-Vector Field Navigation and Modular Q-learning for Soccer Robots

The robot soccer system is being used as a test bed to develop the next generation of field robots. In the multiagent system, action selection is important for the cooperation and coordination among agents. There are many techniques in choosing a proper action of the agent. As the environment is dynamic, reinforcement learning is more suitable than supervised learning. Reinforcement learning is based on trial and error method through experience. Because of this, reinforcement learning is applied to many practical problems. However, straightforward application of reinforcement learning algorithm may not successfully scale up to more complex multi-agent learning problems. To solve this problem, modular Q-learning is employed for multi-agent learning in reinforcement methods. A modified uni-vector field is used for robot navigation. This paper discusses the Y2K2 NaroSot(Nano-Robot World Cup Soccer Tournament) robot soccer system.